Results

Paired Samples T-Test

Paired Samples T-Test
Measure 1   Measure 2 Test Statistic z df p Effect Size SE Effect Size
Max - system Student -1.565   99 .121 -0.156 0.117
Wilcoxon 1,453.500 -1.478 .140 -0.186 0.125
Note.  For the Student t-test, effect size is given by Cohen's d . For the Wilcoxon test, effect size is given by the matched rank biserial correlation.

Assumption Checks

Test of Normality (Shapiro-Wilk)
      W p
Max - system 0.975 .053
Note.  Significant results suggest a deviation from normality.

Descriptives

Descriptives
  N Mean SD SE Coefficient of variation
Max 100 74.46 20.81 2.081 0.279
system 100 78.16 19.93 1.993 0.255

Raincloud Plots

Max - system

Raincloud Difference Plots

Max - system

Bar Plots

Max - system

Bayesian Paired Samples T-Test

Bayesian Paired Samples T-Test
Measure 1   Measure 2 BF₁₀ error %
Max - system 0.359 0.054

Bar Plots

Max - system

Descriptives

Raincloud Plots

Max - system

Correlation

Correlation Table
Pearson
Spearman
Kendall
      r p rho p tau B p
expert1 - expert2 0.050 .621 0.070 .491 0.053 .495
expert1 - expert3 -0.066 .514 0.190 .058 0.168 * .039
expert1 - expert4 0.043 .673 0.005 .961 0.005 .951
expert1 - expert5 0.360 *** < .001 0.379 *** < .001 0.315 *** < .001
expert1 - expert6 0.455 *** < .001 0.367 *** < .001 0.269 *** < .001
expert1 - expert7 0.560 *** < .001 0.427 *** < .001 0.336 *** < .001
expert1 - expert8 0.309 ** .002 0.277 ** .005 0.212 ** .005
expert1 - expert9 0.160 .111 0.113 .262 0.092 .233
expert1 - expert10 -0.231 * .021 -0.140 .164 -0.104 .180
expert1 - system 0.159 .115 0.166 .099 0.123 .111
expert1 - Min 0.509 *** < .001 0.451 *** < .001 0.387 *** < .001
expert1 - Max 0.344 *** < .001 0.360 *** < .001 0.262 *** < .001
expert1 - Mean 0.484 *** < .001 0.451 *** < .001 0.350 *** < .001
expert1 - Median 0.440 *** < .001 0.451 *** < .001 0.358 *** < .001
expert2 - expert3 0.136 .178 0.355 *** < .001 0.280 *** < .001
expert2 - expert4 0.520 *** < .001 0.483 *** < .001 0.380 *** < .001
expert2 - expert5 0.201 * .045 0.124 .220 0.093 .237
expert2 - expert6 0.200 * .046 0.235 * .019 0.211 ** .004
expert2 - expert7 0.349 *** < .001 0.246 * .014 0.180 * .020
expert2 - expert8 0.321 ** .001 0.355 *** < .001 0.264 *** < .001
expert2 - expert9 0.343 *** < .001 0.360 *** < .001 0.263 *** < .001
expert2 - expert10 0.101 .320 0.121 .232 0.085 .258
expert2 - system 0.422 *** < .001 0.391 *** < .001 0.281 *** < .001
expert2 - Min 0.121 .230 0.108 .284 0.071 .386
expert2 - Max 0.589 *** < .001 0.572 *** < .001 0.399 *** < .001
expert2 - Mean 0.600 *** < .001 0.662 *** < .001 0.449 *** < .001
expert2 - Median 0.474 *** < .001 0.536 *** < .001 0.372 *** < .001
expert3 - expert4 0.162 .107 0.055 .585 0.050 .526
expert3 - expert5 0.172 .086 0.032 .749 0.028 .737
expert3 - expert6 0.414 *** < .001 0.468 *** < .001 0.363 *** < .001
expert3 - expert7 0.186 .064 0.335 *** < .001 0.250 ** .002
expert3 - expert8 -0.016 .878 0.025 .802 0.024 .754
expert3 - expert9 0.216 * .031 0.204 * .042 0.165 * .035
expert3 - expert10 0.404 *** < .001 0.413 *** < .001 0.327 *** < .001
expert3 - system -0.054 .592 0.221 * .027 0.163 * .037
expert3 - Min -7.974×10-4 .994 0.152 .131 0.153 .072
expert3 - Max 0.307 ** .002 0.594 *** < .001 0.468 *** < .001
expert3 - Mean 0.466 *** < .001 0.547 *** < .001 0.419 *** < .001
expert3 - Median 0.503 *** < .001 0.404 *** < .001 0.309 *** < .001
expert4 - expert5 0.247 * .013 0.190 .058 0.147 .062
expert4 - expert6 0.085 .399 0.092 .364 0.071 .340
expert4 - expert7 0.048 .635 0.047 .644 0.040 .602
expert4 - expert8 0.462 *** < .001 0.492 *** < .001 0.379 *** < .001
expert4 - expert9 0.322 ** .001 0.330 *** < .001 0.247 *** < .001
expert4 - expert10 -0.042 .676 -0.068 .499 -0.054 .469
expert4 - system 0.148 .141 0.091 .368 0.065 .383
expert4 - Min 0.032 .751 0.040 .696 0.024 .772
expert4 - Max 0.317 ** .001 0.257 ** .010 0.195 ** .009
expert4 - Mean 0.469 *** < .001 0.466 *** < .001 0.353 *** < .001
expert4 - Median 0.481 *** < .001 0.447 *** < .001 0.335 *** < .001
expert5 - expert6 0.449 *** < .001 0.309 ** .002 0.241 ** .002
expert5 - expert7 0.566 *** < .001 0.581 *** < .001 0.481 *** < .001
expert5 - expert8 0.280 ** .005 0.422 *** < .001 0.320 *** < .001
expert5 - expert9 -0.082 .418 -0.145 .150 -0.102 .194
expert5 - expert10 -0.071 .483 -0.220 * .027 -0.165 * .035
expert5 - system 0.250 * .012 0.260 ** .009 0.204 ** .009
expert5 - Min 0.585 *** < .001 0.774 *** < .001 0.678 *** < .001
expert5 - Max 0.349 *** < .001 0.350 *** < .001 0.273 *** < .001
expert5 - Mean 0.568 *** < .001 0.439 *** < .001 0.332 *** < .001
expert5 - Median 0.581 *** < .001 0.475 *** < .001 0.371 *** < .001
expert6 - expert7 0.761 *** < .001 0.669 *** < .001 0.525 *** < .001
expert6 - expert8 0.189 .059 0.201 * .045 0.149 * .041
expert6 - expert9 0.205 * .041 0.161 .109 0.135 .068
expert6 - expert10 0.110 .275 0.050 .625 0.049 .504
expert6 - system 0.209 * .037 0.200 * .046 0.150 * .042
expert6 - Min 0.520 *** < .001 0.428 *** < .001 0.346 *** < .001
expert6 - Max 0.620 *** < .001 0.657 *** < .001 0.517 *** < .001
expert6 - Mean 0.774 *** < .001 0.711 *** < .001 0.550 *** < .001
expert6 - Median 0.755 *** < .001 0.718 *** < .001 0.566 *** < .001
expert7 - expert8 0.284 ** .004 0.282 ** .004 0.219 ** .004
expert7 - expert9 0.145 .151 0.063 .535 0.058 .452
expert7 - expert10 0.006 .950 -0.022 .829 -0.004 .958
expert7 - system 0.426 *** < .001 0.357 *** < .001 0.283 *** < .001
expert7 - Min 0.735 *** < .001 0.754 *** < .001 0.665 *** < .001
expert7 - Max 0.704 *** < .001 0.676 *** < .001 0.543 *** < .001
expert7 - Mean 0.796 *** < .001 0.717 *** < .001 0.532 *** < .001
expert7 - Median 0.710 *** < .001 0.690 *** < .001 0.537 *** < .001
expert8 - expert9 -0.037 .718 -0.051 .613 -0.036 .622
expert8 - expert10 -0.284 ** .004 -0.274 ** .006 -0.199 ** .007
expert8 - system 0.332 *** < .001 0.346 *** < .001 0.261 *** < .001
expert8 - Min 0.434 *** < .001 0.453 *** < .001 0.376 *** < .001
expert8 - Max 0.281 ** .005 0.284 ** .004 0.202 ** .006
expert8 - Mean 0.411 *** < .001 0.490 *** < .001 0.352 *** < .001
expert8 - Median 0.431 *** < .001 0.534 *** < .001 0.414 *** < .001
expert9 - expert10 0.247 * .013 0.341 *** < .001 0.274 *** < .001
expert9 - system -0.160 .112 -0.208 * .038 -0.159 * .033
expert9 - Min 0.032 .752 -0.032 .748 -0.018 .828
expert9 - Max 0.445 *** < .001 0.375 *** < .001 0.363 *** < .001
expert9 - Mean 0.484 *** < .001 0.455 *** < .001 0.350 *** < .001
expert9 - Median 0.439 *** < .001 0.400 *** < .001 0.299 *** < .001
expert10 - system -0.212 * .034 -0.193 .054 -0.132 .076
expert10 - Min -0.115 .253 -0.116 .250 -0.082 .311
expert10 - Max 0.320 ** .001 0.354 *** < .001 0.269 *** < .001
expert10 - Mean 0.233 * .020 0.205 * .041 0.154 * .031
expert10 - Median 0.140 .164 0.065 .521 0.051 .479
system - Min 0.282 ** .004 0.301 ** .002 0.254 ** .002
system - Max 0.327 *** < .001 0.360 *** < .001 0.276 *** < .001
system - Mean 0.303 ** .002 0.343 *** < .001 0.283 *** < .001
system - Median 0.249 * .013 0.313 ** .001 0.244 *** < .001
Min - Max 0.501 *** < .001 0.508 *** < .001 0.403 *** < .001
Min - Mean 0.561 *** < .001 0.543 *** < .001 0.442 *** < .001
Min - Median 0.483 *** < .001 0.514 *** < .001 0.437 *** < .001
Max - Mean 0.830 *** < .001 0.876 *** < .001 0.708 *** < .001
Max - Median 0.654 *** < .001 0.702 *** < .001 0.522 *** < .001
Mean - Median 0.928 *** < .001 0.918 *** < .001 0.772 *** < .001
* p < .05, ** p < .01, *** p < .001

Heatmaps

Pearson's r

Spearman's rho

Kendall's tau B